Multicentre sleep-stage scoring agreement in the Sleep Revolution project.

Determining sleep stages accurately is an important part of the diagnostic process for numerous sleep disorders. However, as the sleep stage scoring is done manually following visual scoring rules there can be considerable variation in the sleep staging between different scorers. Thus, this study aimed to comprehensively evaluate the inter-rater agreement in sleep staging. A total of 50 polysomnography recordings were manually scored by 10 independent scorers from seven different sleep centres. We used the 10 scorings to calculate a majority score by taking the sleep stage that was the most scored stage for each epoch. The overall agreement for sleep staging was κ = 0.71 and the mean agreement with the majority score was 0.86. The scorers were in perfect agreement in 48% of all scored epochs. The agreement was highest in rapid eye movement sleep (κ = 0.86) and lowest in N1 sleep (κ = 0.41). The agreement with the majority scoring varied between the scorers from 81% to 91%, with large variations between the scorers in sleep stage-specific agreements. Scorers from the same sleep centres had the highest pairwise agreements at κ = 0.79, κ = 0.85, and κ = 0.78, while the lowest pairwise agreement between the scorers was κ = 0.58. We also found a moderate negative correlation between sleep staging agreement and the apnea-hypopnea index, as well as the rate of sleep stage transitions. In conclusion, although the overall agreement was high, several areas of low agreement were also found, mainly between non-rapid eye movement stages.

Self-applied somnography: technical feasibility of electroencephalography and electro-oculography signal characteristics in sleep staging of suspected sleep-disordered adults.

Sleep recordings are increasingly being conducted in patients' homes where patients apply the sensors themselves according to instructions. However, certain sensor types such as cup electrodes used in conventional polysomnography are unfeasible for self-application. To overcome this, self-applied forehead montages with electroencephalography and electro-oculography sensors have been developed. We evaluated the technical feasibility of a self-applied electrode set from Nox Medical (Reykjavik, Iceland) through home sleep recordings of healthy and suspected sleep-disordered adults (n = 174) in the context of sleep staging. Subjects slept with a double setup of conventional type II polysomnography sensors and self-applied forehead sensors. We found that the self-applied electroencephalography and electro-oculography electrodes had acceptable impedance levels but were more prone to losing proper skin-electrode contact than the conventional cup electrodes. Moreover, the forehead electroencephalography signals recorded using the self-applied electrodes expressed lower amplitudes (difference 25.3%-43.9%, p < 0.001) and less absolute power (at 1-40 Hz, p < 0.001) than the polysomnography electroencephalography signals in all sleep stages. However, the signals recorded with the self-applied electroencephalography electrodes expressed more relative power (p < 0.001) at very low frequencies (0.3-1.0 Hz) in all sleep stages. The electro-oculography signals recorded with the self-applied electrodes expressed comparable characteristics with standard electro-oculography. In conclusion, the results support the technical feasibility of the self-applied electroencephalography and electro-oculography for sleep staging in home sleep recordings, after adjustment for amplitude differences, especially for scoring Stage N3 sleep.

Multi-centre arousal scoring agreement in the Sleep Revolution.

We investigated arousal scoring agreement within full-night polysomnography in a multi-centre setting. Ten expert scorers from seven centres annotated 50 polysomnograms using the American Academy of Sleep Medicine guidelines. The agreement between arousal indexes (ArIs) was investigated using intraclass correlation coefficients (ICCs). Moreover, kappa statistics were used to evaluate the second-by-second agreement in whole recordings and in different sleep stages. Finally, arousal clusters, that is, periods with overlapping arousals by multiple scorers, were extracted. The overall similarity of the ArIs was fair (ICC = 0.41), varying from poor to excellent between the scorer pairs (ICC = 0.04-0.88). The ArI similarity was better in respiratory (ICC = 0.65) compared with spontaneous (ICC = 0.23) arousals. The overall second-by-second agreement was fair (Fleiss' kappa = 0.40), varying from poor to substantial depending on the scorer pair (Cohen's kappa = 0.07-0.68). Fleiss' kappa increased from light to deep sleep (0.45, 0.45, and 0.53 for stages N1, N2, and N3, respectively), was moderate in the rapid eye movement stage (0.48), and the lowest in the wake stage (0.25). Over a half of the arousal clusters were scored by one or two scorers, and less than a third by at least five scorers. In conclusion, the scoring agreement varied depending on the arousal type, sleep stage, and scorer pair, but was overall relatively low. The most uncertain areas were related to spontaneous arousals and arousals scored in the wake stage. These results indicate that manual arousal scoring is generally not reliable, and that changes are needed in the assessment of sleep fragmentation for clinical and research purposes.